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(57) Abstract 

A method and system for analyzing data over a network are described. A Web server communicates with a storage system that 
stores genomic information in a database. Client systems connect to the Web server over a network, such as the Internet, using standard 
Web protocols (e.g., HTTP). The Web server sends Web pages to the client through which pages the user of the client can load genomic 
information into the database. The. client user obtains the genomic information for uploading from genomic samples of organisms hybridized 
to chips or arrays. With the database populated with genomic information, the client user interactively selects and performs an analysis 
on selected samples over the network. The result produced by the analysis is a list of genes or a list of gene lists that becomes part of 
the database. These gene lists or lists of gene lists can then be compared with other previously stored lists or with user-generated and/or 
user-selected gene lists. Accordingly, subsequent users of the database can review the research performed by others, and incorporate that 
research into their own research. 
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A METHOD AND RELATIONAL DATABASE MANAGEMENT SYSTEM FOR 
STORING, COMPARING, AND DISPLAYING RESULTS PRODUCED BY ANALYSES 
OF GENE ARRAY DATA 

Related Application 

This application claims the benefit of the filing date of copending U.S. Provisional 
Application, Serial No. 60/134,793, filed May 19, 1999, entitled "Relational Database 
Management System For Gene Array Data," the entirety of which provisional application is 
incorporated by reference herein. 

5 Background of the Invention 

Array-based expression analysis tools permit the simultaneous measurement of RNA 
expression levels for all or part of the genome of an organism. Arrays, or "expression chips", 
that probe every ORF (open reading frame) in the yeast genome, as well as for several other 
organisms, are now commercially available. Chips probing expression levels of up to 10,000 
10 human genes and ESTs (expressed sequence tags) are also available. The accessibility of 

parallel expression analysis has ushered in a new era of genetic discovery, where the full genetic 
behavior of an organism is measurable in parallel. This widely applicable technology is being 
applied to problems in yeast biology, functional genomics, drug discovery, and other domains. 

Despite the great promise that expression profiling holds for biology research, anyone 
1 5 attempting to use array technology quickly discovers that the ability to produce biological data 
does not imply an ability to interpret that data. Consequently, management and interpretation of 
the massive data sets produced by expression analysis tools have become a bottleneck in 
biological research. Techniques used to analyze expression data, which range from pencil and 
paper to computerized spread sheets, do not provide an adequate means for solving the problems 
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presented by massive data sets: for example, filtering noise, comparing across data sets, 
annotating entire genomes, measuring experimental error, and extracting meaningful information 
from as many as 100,000 data points. Thus, there is a need for data analysis tools that enable 
researchers to extract information about individual genes across specific conditions as well as 
5 integrate large amounts of data to provide an overall picture of expression remodeling under 
various experimental conditions. 

Summary of the Invention 

An object of the invention is to automate many of the processes necessary for analyzing 
data such as for example genomic information obtained from chips or gene arrays. Such 

1 0 processes include loading data sets, rescaling data from different arrays so the data can be 

compared, data management, and analysis. Another object is to provide data visualization tools 
that facilitate the interpretation of the results of analyses. Still another object of the invention is 
to enable researchers to compare different samples in the database, without diminishing the 
capability of the researchers to learn as much from individual experiments as possible. 

1 5 To achieve these and other objects, a method and relational database management system 

for storing, comparing, and displaying results produced by analyses of gene array data are 
provided. A Web server communicates with a storage system that stores genomic information in 
a database. Client systems connect to the Web server over a network, such as the Internet, using 
standard Web protocols (e.g., HTTP). The Web server sends Web pages to the client through 

20 which pages the user of the client can load genomic information into the database. The client 
user obtains the genomic information for uploading from genomic samples of organisms 
hybridized to chips or arrays. With the database populated with genomic information, the client 
user interactively selects and performs an analysis on selected samples over the network. The 
result produced by the analysis is a list of genes or a list of gene lists that becomes part of the 
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database. These gene lists or lists of gene lists can then be compared with other previously 
stored lists or with user-generated and/or user-selected gene lists. Accordingly, subsequent users 
of the database can review the research performed by others, and incorporate that research into 
their own research. 

5 In one aspect, the invention features a method for analyzing data. The method comprises 

providing data and rescaling the data to produce rescaled data. The rescaled data may be stored 
in the same database as the sample result. The rescaled data is associated with a pre-selected set 
of parameters. A sample set is generated from the associated rescaled data. Analysis is 
performed on the sample set to produce a sample result, and the sample result is stored in a 
10 database. The stored sample result is associated with a prior result. The prior result can be a 

sample result previously stored in the database, a user-generated result, or a user-selected result. 

In one embodiment, the stored sample result is a list of lists. Each list in the list of lists is 
a list of genes. In another embodiment, the stored sample result is a set of bit vectors. In still 
another embodiment, the associating comprises comparing the sample result with the prior result. 
15 The results of associating the stored sample result with prior result may be stored in the database. 

In another aspect, the invention features a system for analyzing data. The system 
includes a calibrator rescaling the data and a pre-selected set of parameters that is associated with 
the rescaled data. A sample set is generated from the associated rescaled data. An analyzer 
performs analysis on the sample set to produce a sample result. A database stores the sample 
20 result. An associator associates the stored sample result with a prior result. The prior result can 
be a sample result previously stored in the database, a user-generated result, or a user-selected 
result. 
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Brief Description of the Drawings 

The invention is pointed out with particularity in the appended claims. The advantages of 
the invention described above, as well as further advantages of the invention, may be better 
understood by reference to the following description taken in conjunction with the 
5 accompanying drawings, in which: 

Fig. 1 is a block diagram of client-server network providing database services according 
to the principles of the invention; 

Fig. 2 is flow diagram of an embodiment of a process in which the client user accesses 
the database according to the principles of the invention; 
10 Fig. 3 is a screen shot illustrating an embodiment of a graphical user interface presented 

to the client user for entering sample data into the database of the invention; 

Fig. 4 is a screen shot illustrating an embodiment of a graphical user interface presented 
to the client user for performing a rule-based analysis on a set of samples; 

Fig. 5 is a screen shot illustrating an embodiment of a graphical user interface presented 
15 to the client user for performing comparisons between sample results and/or user-selected or 
generated categories; 

Fig. 6 is a block diagram of an embodiment of a schema of the database of Fig. 1; and 
Fig. 7 is a screen shot illustrating an embodiment of a graphical user interface presented 
to the client user for reporting the results of a search for a particular gene in the sample results 
20 stored in the database. 

Detailed Description 

FIG. 1 shows a computing system (client) 10 in communication with a computing system 
(server) 20 over a network 30. The server 20 is in communication with a storage system 40 
providing storage for genomic information and, in accordance with the principles of the 
25 invention, storage for the results of analyses performed on the genomic information. It is to be 
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understood that more clients and servers than those shown can be connected to the network 30. 
Although shown in Fig. 1 as separate systems, in another embodiment the client 10 and server 20 
can be the same machine. 

The client 10 can be any personal computer (e.g., 286, 386, 486, Pentium, Pentium II), 
5 thin-client device, Macintosh computer, Windows-based terminal, Network Computer, wireless 
device, information appliance, RISC Power PC, X-device, workstation, mini computer, main 
frame computer, or other computing device that has a graphical user interface. Windows- 
oriented platforms supported by the client 10 can include Windows 3.x, Windows 95, Windows 
98, Windows NT 3.51, Windows NT 4.0, Windows CE, Windows CE for Windows Based 
10 Terminals, Macintosh, Java, and Unix. The client 10 includes conventional hardware for 

supporting a display screen, a keyboard, memory, a processor, and an input/output device (e.g., a 
mouse). 

The client 10 also has software including browser software 12, e.g., Microsoft Internet 
Explorer™ produced by Microsoft Corporation of Redmond Washington. The browser software 
15 12 provides a graphical user interface to the server 20. Through the Web browser, the client 10 
develops and submits search requests for retrieving data from the storage system 40. In general, 
the user of the client formulates queries of the storage system 40, using the keyboard and the 
input device to point and click on graphical buttons, pull down menus, scroll bars, etc., that are 
then submitted to the server 20 over the network 30 

20 Server 20 includes the hardware necessary for running software to access information in 

the storage system 40 in response to client user requests, and for providing an interface for 
transmitting information to the client 10. In one embodiment, the server 20 operates as a Web 
server 32, supporting the World Wide Web protocol (e.g., HTTP protocol) for providing page 
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data to the client 10, maintaining Web pages, processing URLs, and controlling access to other 
portions of the network 30 (e.g., workstations, storage systems, printers) or to other networks. In 
one embodiment, the server 20 is a 233 MHz Pentium II running on a Windows NT 4.0 
workstation. In another embodiment that improves multi-user performance, the server 20 is a 
5 Ultra-4 Sparc workstation running the Solaris 2.6 operating system with four 400 MHz 
processors and 1 GB of RAM (produced by Sun Microsystems). 

As shown, the server 20 includes the World Wide Web server 32, a World Wide Web 
interface 34, and a database management system (DBMS) 36. The Web interface 34 includes the 
executable code necessary for generating queries that access information in the storage system 

10 40 (e.g., database language statements such as Standard Query Language (SQL) statements). 
The Web interface 34 also includes Web applications written in PL/SQL, Perl and Java. On 
Web application enables the client user to directly upload genome expression data files into the 
storage system 40 (hereafter called the loader 35). Other the Web applications provide a Web 
interface to the storage system 40 and perform data analysis such as normalization and 

1 5 comparisons between unlimited number of experiments and functional categorization of an 
organism's genes. 

In general, the database management system (DBMS) 36 serves as a Web-based search 
engine that enables the client user to search for any number of genes according to user-specified 
key words in names or gene description. The search engine also operates to find and download 
20 the expression information for selected genes in user-selected sets of samples. In one 

embodiment, the DBMS 36 is an Oracle™ DBMS 36 with WebDB, which is a product produced 
by Oracle for implementing dynamic HTML (Hypertext Markup Language). 
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The storage system 40 can be any of a variety of systems that maintains information 
including, for example, a database server, a file storage system having large binary files, a legacy 
mini-computer or main-frame computer with storage. In one embodiment, the storage system 40 
includes a relational database 44 in which the information is stored in a relational format. The 

5 relational database 44 includes tables of columns and rows for holding the information stored in 
the database 44. Each table has a primary key that is any column or set of columns storing a 
value or values which uniquely identify the rows in that table. The tables of the relational 
database 44 can also include a column or set of columns that function as a secondary key. The 
values of secondary key columns are used to match the primary key values of another table. The 

1 0 relational database 44 supports a set of operations that are performed on the relations within the 
database 44. 

Implementation of the relational database 44 of the storage system 40 can be 
accomplished in various ways. For example, one embodiment of the relational database 44 is an 
Oracle ™ database. An example of another embodiment of the relational database 44 is a 
1 5 Sybase™ database. 

The network 30 can be a local-area network (LAN), an Intranet, or a wide area network 
(WAN) such as the Internet or the World Wide Web. A user of the client 10 can be connected to 
the network 30 through a variety of connections including standard telephone lines, LAN or 
WAN links (e.g., Tl, T3, 56kb, X.25), broadband connections (ISDN, Frame Relay, ATM), and 
20 wireless connections. The connections can be established using a variety of communication 

protocols (e.g., HTTP, TCP/IP, IPX, SPX, NetBIOS, Ethernet, RS232, and direct asynchronous 
connections). 
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During operation, the client 10 launches the browser software 12 and connects to the 
server 20 by specifying a resource locator corresponding to the server 20. The resource locator 
is specifically referred to as a Uniform Resource Locator (URL), but any type of address scheme 
that defines a path to a resource on the network 30 can be used to practice the principles of the 
5 invention. In response, the Web server 32 of the server 20 sends a document or Web page 38 to 
the client 10. In one embodiment, the Web page is written in HTML. Other document types 
(e.g., XML, SGML) can be used to practice the principles of the invention. An initial Web page 
38 may cause the browser software 12 to prompt the user to log on by supplying a username and 
a password. Proper response by the client user can establish an authenticated session between 
10 the browser 12 and the server 20. Such authentication can be required before the client user is 
granted access to the information stored in the storage system 40. 

Display of the document 38 on the screen of the client 10 produces a graphical user 
interface 14 that the client user can use to formulate his or her requests for access to storage 
system 40. The graphical user interface 14 includes one or more fields for receiving user- 
1 5 specified terms. To enter the terms, the user can click upon the fields with the mouse 42 and 
type in the terms using the keyboard. The document 38 can also include embedded hyperlinks 
pointing to other documents on the server 20 or on servers elsewhere on the network 30. In an 
alternative embodiment, the document 38 presents a line mode interface at the client 10 through 
which the client user submits commands, e.g., using the SQLPLUS™ tool produced by Oracle. 

20 The Web browser 12 formats and transmits the client requests to Web server 32, which 

passes the request to the Web interface 34. The Web interface 34 of the server 20 converts the 
requests to queries in a database language (e.g., SQL). The database management system 36 of 
the server 20 uses the queries to access the relevant information stored in the database 44 and 
returns that information to the server 20 in an appropriate format. The Web server 32 then 
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generates a new document 38 containing the database information and transmits the new 
document 38 to the client 10 where the database information is displayed in the graphical user 
interface 14. 

Fig. 2 shows an embodiment of a process for accessing information in the database 44 
5 according to the principles of the invention. The client user uploads (step 100) raw data into the 
database 44. In one embodiment, the data is genomic data. Other types of data can be used to 
practice the principles of the invention. The raw genomic data is obtained from "chips" (or 
"arrays"). A chip is a solid substrate with DNA probes that are either synthesized or spotted 
onto the substrate surface in a grid layout. Chips may contain from a few hundred to tens of 

10 thousands of probes, each of which corresponds to a single nucleotide sequence of interest. A 
nucleotide sequence in turn corresponds to a genetic feature of interest, such as the coding for a 
specific protein. For example, a probe may refer to a mRNA strand that codes for a specific 
protein or amino acid sequence. Other non-mRNA probes are also placed on chips, so a 
nucleotide sequence may refer to a region upstream of a gene, or to a mitochondrial mRNA or 

15 other genetic material. For example, the Affymetrix GeneChip™ platform determines raw 

genomic data as the average difference score and present call (i.e., a measure of the presence or 
absence of a message) for each probe set on the array. In one embodiment, multiple 
measurements per spot, including the average intensity and background values for each set of 
probes on the array, are supported. 

20 As used hereafter, a data set includes the genomic data that are obtained from the 

hybridization of one sample to a set of chips that span the genome of the organism (or some 
subset of the genome). A sample refers to a colony of cells grown from a particular genetic 
strain of organism (e.g., yeast) that has a particular genotype. Thus, the database services of the 
invention handle each sample independently. 
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Each sample is subjected to a particular treatment, which is an action taken to perturb the 
sample. The sample also can have a time of treatment associated with it. An experiment is a set 
of control and test samples and the analysis that has been applied to such samples. Often some 
of the hybridizations are repeated for quality control purposes. Thus, an experiment testing the 
5 effects of a single treatment may contain many samples. Other experiments study the dynamics 
of the treatment effects and thus entail a time course with samples corresponding to each time 
point measured. 

In step 104, the raw genomic data is rescaled (step 104). The rescaling of the raw 
genomic data, described in more detail below, enables data sets for different chips to be analyzed 

10 together. The client user chooses (step 108) a reference set for the rescaled data. A reference set 
is a set of samples that have been normalized using the same parameters, generally with respect 
to one sample. Rescaled samples within the same reference set can be directly compared in an 
"analysis." Samples can be rescaled to multiple reference sets to enable comparisons between 
disparate sets of rescaled samples. This allows different rescaling decisions to be made (e.g., 

15 control-based vs. bulk-signal based, different flooring values, etc.), but still provides the option 
of making fast comparisons across large segments of the database 44. 

For example, for control-based rescaling, foreign RNA species are added to the sample 
RNA in known quantities as a control for starting material. Probes are present on the chip for 
these foreign RNAs, so their signals can be compared from one chip to another in order to 
20 deduce proper rescaling constants. As another example, for bulk signal normalization the total 
signal of all probes on the chip (or some large subset of probes) are summed or averaged. This 
sum or average is compared between chips. This technique is only for comparisons of chips of 
the same type. Furthermore, if large changes in expression occur to reduce the overall signal, 
then this technique may be ineffective. 
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The Web interface 34 produces (step 1 12) a sample set using the rescaled samples. A 
Web application of the Web interface 34 performs (step 1 16) a user-specified analysis on the 
sample set. As described in more detail below, one embodiment offers two types of analysis: (1) 
rule based analysis, and (2) non-hierarchical clustering analysis. 



5 Execution of the user-specified analysis produces a result (hereafter "sample result"). In 

one embodiment, the sample result is a list of genes (i.e., a "gene list") that are co-expressed in 

some way. An exemplary representation of a list of genes is: 

Sample Result: 
gene 1 

10 gene 2 

gene 3 

In another embodiment, the sample result is a list of lists of genes (i.e., a list of gene 

lists). An exemplary representation of a list of lists of genes is: 

Sample Result: 
1 5 Gene List for Result Type 1 

gene 1 
gene 2 

Gene List for Result Type 2 
gene 3 

20 gene 4 

In still another embodiment, the sample result is a set of bit vectors. An exemplary 
representation of a set of bit vectors is: 
Sample result: 

Result Type 1 Result Type 2 Result Type 3 



gene 1 x x 

gene 2 x x x 

gene 3 x 

gene 4 x x 



Other embodiments of a sample result also include information that is associated with the 
25 genes in the gene list. For example, each gene can be associated with a scalar value representing 
a confidence metric for that gene (e.g., a scalar value of 1 means information about the gene is 
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present; 0 means no information about the gene is present). Accordingly, an embodiment of the 
sample result includes the list of genes and the scalar value associated with each gene. As 
another example, a sample result produced by a clustering analysis (described below) may 
produce a list of centroids associated with the list of genes and a graph representing a network of 
5 relationships among the genes. For this example, the sample result includes the list of centroids 
and the graph in addition to the list of genes. These embodiments of sample results are simply 
illustrative, and are not intended to limit the variety of embodiments of sample results that can be 
used to practice the principles of the invention. 

Rule-based analyses generate results containing genes that were "up" or "down" 
10 according to certain criteria. For example, genes in a list of genes accorded an "up" result had a 
confidence level of present in at least one replicate of both the control and test samples, and 
showed a >=2 relative change in expression from control to test, with a absolute difference of at 
least 100 intensity points. As another example, a list of genes identified as a "down" result is 
similar to an up result, but the relative difference was in the downward direction (i.e. <=.5). 

15 Other examples of sample results include "appeared" and "disappeared." Results 

referred to as "appeared" contain those features whose expression level was marked absent in all 
control samples, but present in all test samples. The expression levels of such genes are those 
that went from undetectable to detectable. Results referred to as "disappeared" contain those 
genetic features whose expression level was marked present in all control samples, but absent in 

20 all test samples. 

The sample result is stored (step 120) in the database 44. The client user (or any other 
client user that accesses the database, whether through the same client 10 or a different client 
system) can associate (step 124) the stored sample result with a prior result. In one embodiment, 
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this association is a comparison between the stored sample result and a prior result. The 
comparison in one embodiment looks for genes that appear in both the stored sample result and 
the prior result. 



The prior result can be another sample result derived from a previous analysis performed 
5 on the information in the database 44 or the prior result can be a user-created or predefined list 
stored in the database 44. An example of a predefined list is a MlPS-generated categorization 
list. MIPS stands for the Munich Information Center for Protein Sequences and is a 
bioinformatics group that publishes various functional categorizations of genes on the Internet. 
The following is an example of a small portion of the functional categorizations of yeast genes 
10 published by MIPS: 

TRANSCRIPTION (751 ORFs) 

rRNA transcription (100 ORFs) 

rRNA synthesis (39 ORFs) 

rRNA processing (58 ORFs) 
15 other rRNA-transcription activities (3 ORFs) 

tRNA transcription (82 ORFs) 

tRNA synthesis (24 ORFs) 

tRNA processing (37 ORFs) 

tRNA modification (16 ORFs) 
20 other tRNA-transcription activities (4 ORFs) 

mRNA transcrition (544 ORFs) 

mRNA synthesis (410 ORFs) 

general transcription activities (64 ORFs) 

transcriptional control (326 ORFs) 
25 chromatin modification (32 ORFs) 

mRNA processing (splicing) (91 ORFs) 

mRNA processing (5'-, 3'-end processing, mRNA degradation) (37 ORFs) 
other mRNA-transcription activities (1 0 ORFs) 
RNA transport (27 ORFs) 
30 other transcription activities (58 ORFs) 

PROTEIN SYNTHESIS (347 ORFs) 
ribosomal proteins (206 ORFs) 

translation (initiation, elongation and termination) (62 ORFs) 
translational control (30 ORFs) 
35 tRNA-synthetases (37 ORFs) 

other protein-synthesis activities (15 ORFs) 
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Each item in the MIPS list is a hyperlink to additional information regarding the 
functional category. For example, selecting the "other tRNA-transcription activities (4 ORFs)" 
hyperlink produces a Web page with the following list of genes that fall under the "other tRNA- 
transcription activities" category: 



Other examples of user-created or user-selected lists that can be stored in the database 44 are 
10 lists of chromosomes, transcription factor targets, and functional categories (e.g., metabolism 
genes). 

Fig. 3 illustrates an embodiment of a graphical user interface 130 displayed at the client 
10 upon execution of the loader 35 described in Fig. 1. The loader 35 supports file uploads from 
any computer system attached to the network 30 (e.g., the client 10), and provides HTTP 
15 protocol support for loading data sets from an internal web-site. Furthermore, the loader 35 
allows the client user to associate the loaded data sets with information describing the 
experiment, such as genetic strains (in field 138), growth conditions used (in field 134), and 
sample treatment (in field 136). Additionally, chip lot numbers can be entered in fields 139 in 
order to track problems with chip and reagent quality. 

20 In one embodiment, the loader 35 is implemented by a suite of common gateway 

interface (CGI) programs and modules, written in PERL, that handle the uploading of data sets to 
the database 44. Perl is effective for text file processing and provides a simple and well- 
supported database interface. It is to be understood that the loader 35 can be implemented in 
other ways, e.g., as an application program interface (API). 



5 



YOR061W CKA2 
YOR039w CKB2 
YIL035c CKA1 
YJL04 1 w NSP1 



casein kinase II alpha' chain 
casein kinase II beta' chain 

casein kinase II, catalytic alpha chain 

nuclear pore protein 
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To keep data set load times to a minimum, and thus provide acceptable interactive 
response to the client user, the loader 35 inserts raw data row by row into an empty temporary 
table. The loader 35 then selects and inserts the raw data at once into a large table containing all 
data sets. In one embodiment, this large table contains 1.6 x 10 6 rows. This load optimization 
5 technique improves insert times and reduces rollback space consumption considerably. Also, the 
optimization technique causes insert times to be proportional to the size of the data set being 
inserted rather than the size of the table. 

Rescaling data sets 

Before data sets for different chips can be analyzed together, calibration or rescaling of 
10 the raw data in the data sets is necessary. The rescaling can be performed in a variety of ways 
depending on the nature of the experiment. For example, known quantities of exogenous control 
RNAs can be used for rescaling data values read from one chip to those read from another chip. 
For experiments in which the overall mRNA population is expected to remain stable, bulk signal 
scaling methods can also be employed. In situations where overall expression is significantly 
1 5 affected, for example when parts of the transcription apparatus are knocked out or inactivated 
because of temperature-sensitive mutations, then control-based rescaling is appropriate. Still 
referring to Fig. 3, the loader 35 allows the client user to choose the rescaling method (by 
specifying a reference set in field 135) and associated parameters when data set is loaded. The 
loader 35 also provides a set of default options (in field 137) that represent the typical parameters 
20 for rescaling. 

To implement rescaling, a reference set is defined to include a sample used as a control 
for rescaling, a rescaling algorithm and any parameters that the rescaling requires, and a set of 
samples whose chips are rescaled to the chips from the control sample. Currently all available 
rescaling algorithms are stable with respect to the contents of the reference set; that is, adding 
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additional samples to the reference set does not affect the rescaled values of the samples already 
present in the reference set. Samples can be added to more than one reference set, in which case 
the rescaled values are stored separately for each reference set. 

Not all data types are directly comparable. For example, certain measurements are only 
5 useful in a given context, while others measurements are absolute with respect to a set of 

experimental conditions. The rescaling of data sets occurs for just those data values that can be 
directly compared, as defined by the client user through the graphical user interface, but does not 
allow direct comparison of data values derived from different reference sets. The user assures 
that samples are correctly normalized (i.e., added to appropriate reference sets). If the samples 
10 are normalized correctly, then the database system constrains client users from making 
comparisons across reference sets, thus preventing comparisons across normalizations. 
Comparisons of data values derived from different reference sets occur at a higher level (e.g., 
during "data mining", as described below in connection with the section called "Data Mining"). 

Genetic namespaces 

15 To enable querying the information in the database 44 and comparing information from 

different chips, probe names are "standardized" through a series of tables that map the physical 
probe names provided by the chip manufacturer to a unique set of genetic feature names for each 
organism. Accordingly, the genomic data is stored in the database 44 in two formats, the raw, 
unprocessed data and in a format that is optimized for analysis and querying (e.g., with genetic 

20 feature names). 

This mapping of data sets into a genetic feature namespace simplifies comparisons across 
samples. This namespace is represented by a genetic feature table that contains one entry per 
genetic feature (e.g., gene, gene fragment, group of genes, or intergenic region) that is measured 
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by a chip probe. To map from physical chip probes to genetic features, a scheme is employed, 
which chooses the "best" probe on a chip for each genetic feature that is represented, based on a 
set of empirically chosen rules. Additionally, to make cross-technology comparisons, (e.g., from 
different chip manufacturers) a unique gene catalog describing every gene queried by a chip is 
5 used so that measurements of the same gene described under two different accession numbers 
can still be compared. 

Data Retrieval 

After loading and rescaling data sets, the client user can extract information from the 
database 44 using a retrieval tool (i.e., a Web application on the server 20) that allows the client 
1 0 user to select a set of genes across a set of samples, and download the resulting matrix as text or 
as an HTML table. The client user can load the resulting file into a spreadsheet for local (i.e., 
client 10) analysis. 

Data Organization - Projects and Gene Categories 

To organize the information stored in the database 44, the data used in analyses are 
15 divided into projects. Each project contains a sample set, which is a group of related samples 

derived from the same reference set. These sample sets can then be analyzed, to produce a set of 
results (i.e., a sample result). Each sample result can contain a list of genes or a list of gene lists 
and numeric values that describe that gene list, such as, for example, a centroid. Presumably the 
genes in a gene list are those genes that were co-expressed in an experiment. Each project is 
20 associated with an individual (e.g., a researcher). In the schema of the database 44, described 
below in connection with Fig. 6, each project is an entry in the PROJECTS table. 
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Groups of genes 

Another mechanism for organizing the information in the database 44 is to place genes 
into user-defined categories. The categories can then be placed into groups. The MIPS 
functional catalogues described above is an example of this organizational mechanism. As 
5 described in more detail in the Data Mining section below, these user-defined lists of genes can 
be compared with lists of genes (or lists of gene lists) that are produced by user-specified 
analyses. 

Data extraction 

The manner of storage of the information in the database 44 facilitates extraction of the 
10 data sets for external analysis (i.e., local analysis) by the client user (e.g., using a spread sheet). 
Further, the client user can extract data sets for multiple samples across a group of features. Set 
operations (i.e., AND, OR, etc.) on features are also supported. For example, the set of genes 
up-regulated across a particular time course experiment can be combined with those genes that 
were down-regulated. The resulting combined set of rows can be extracted across the samples 
1 5 involved in the particular time course experiment or some other time course experiment for 
external analysis. 

Data Set Analysis 

To analyze the data sets stored in the database 44, the client user groups samples into 
sample sets. As described above, all samples in a sample set are from the same reference set, 
20 and sample sets are stored under projects for data organizational purposes. An analysis produces 
a comparison of the samples in the sample set to derive multiple lists of genetic features whose 
expression has been affected in some particular way. In a previously noted embodiment, sample 
sets can be analyzed using one of two tools: rule-based analysis and non-hierarchical clustering. 
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Rule-based analysis 

Within the sample set, each sample plays a role, e.g. wild-type replica 0, time point 15' 
replica 1 . Replicas are repeated experiments which can be used by analysis to control for 
experimental noise. After assigning roles to the samples, the client user chooses the rules to 
5 apply to the analysis of those samples. The client user selects the rules to apply from a set of 
predefined rules. The Web interface 34 then executes the selected rules in the DBMS 36 to 
produce a list or lists of affected genes. This sample result is then stored in the database 44, 
available to subsequent searches by client users. 

Rule-based analysis allows the user to choose a set of predefined rules that determine 
10 which genes are co-expressed. An example of a rule is "all ORFs whose expression levels 
change by a factor of 2." An example of another rule is "all ORFs whose average expression 
levels across replicates monotonically increase over time and for which at least half of the 
measurements for each time point are of high confidence." Fig. 4 shows a screen shot of an 
exemplary graphical user interface 140 presented to the client user to perform a rule-based 
15 analysis. 

In one embodiment, rule based analysis is implemented as an external module that uses R 
package of statistical programs, which is an implementation of the S programming language for 
mathematical modeling, and interacts with the database 44 through the DBMS 36. The R 
language is described in Ihaka & Gentleman (1996), "R: A Language for Data Analysis and 
20 Graphics", Journal of Computational and Graphical Statistics, 5, 299-314. CGI programs, 

written in PERL, control the R programs to provide a graphical user interface. Analyses written 
in R can extract a matrix of values from the database 44 corresponding to expression levels 
across a sample set, and determine which genetic features are co-regulated. The R programs 
directly load the results of the rule-based analysis in the database 44. 



WO 00/70556 PCT/US00/13823 
-20- 

Cluster analysis 

Cluster analyses, in general, allow the detection of patterns in gene expression without 
requiring previous knowledge about what those patterns should look like. After defining a 
sample set, the client user can export the data of the samples in the sample set and employ a 
5 variety of analysis tools to detect such patterns. An example of a type of analysis tool applies a 
self-organizing map algorithm to cluster genes. One such analysis tool is called 
GENECLUSTER, which is software produced by Whitehead Institute Center For Genome 
Research of Cambridge, Massachusetts. Other analysis tools can be used to analyze the sample 
set. 

The analysis tool then uploads the output files resulting the analysis to the database 44. 
Such output files are then stored in the same particular format (e.g., a list of genes) as results 
produced by rule-based analysis. For example, the resulting cluster and associated centroids 
(i.e., average expression profiles) produced by an analysis tool are returned to the database 44 for 
further analysis as described below in the Data Mining section. A feature of the invention is that 
the results produced by the analysis tool are stored in the particular format to enable the 
comparison of results produced by different analyses irrespective of the type of analysis used. 
This particular format allows the addition of various programs serving as analysis tools without 
modifying the underlying database structure. 

Data Visualization 

20 After analyzing a sample set, client user can browse the resulting list(s) of genes 

associated with the analysis and their expression levels through the execution of a Java applet. 
The Java applet plots intensity levels or intensity fold changes using color display and produces 
simultaneous visualization of the expression levels of numerous genes. A fold change refers to 
the relative change in expression of an mRNA between treated vs. untreated (or mutant vs. wild- 
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type) cells. It is reported as a positive number if the ratio is >=1, and as the negative reciprocal 
of the ratio if it is <1 . Additionally, the R package of programs provides a set of plotting tools 
for visualizing the data. For example, some R programs plot histograms of log fold changes 
between chips or samples. 

5 Data Mining 

The above-described analysis and visualization tools allow client users to seek answers to 
questions involving a small number of samples. In accordance with the principles of the 
invention, the client user can also seek answers to questions that encompass different data sets or 
the entire database 44. As described below, the ability to compare different lists of genes 
1 0 provides a data mining capability. 

As described above, sample results are stored in the database 44 as a set (i.e., list) of 
genes. Consequently, any user of a client connected to the server 20 can browse and search 
search through results produced by the analyses of other client users. Such searches for genes by 
name, strain, sample, condition, or by gene membership. For example, a client user can obtain 
1 5 answers to queries such as "what analyses showed a change in expression for gene X". 

After the sample results are stored into the database 44, the client user can also compare 
those sample results with other previously stored sample results. Further, such stored sample 
results can be compared with other lists of genes, for example, user-defined gene lists or 
literature-derived classifications of genes, such as the MIPS functional catalogues. This 
20 capability enables the comparison of sample results to external information, such as knowledge 
extracted from scientific literature. The client user can categorize such knowledge based on 
whatever criteria they choose. These user-defined categorizations have a particular format 
adapted to facilitate comparisons with sample results stored in the database 44. The particular 
format follows a semi-hierarchical scheme for representing information, such as the MIPS 
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classifications, by function and structure. When comparing a sample result with a 
categorization, the sample result is considered to be a list of co-expressed genes. 

In one embodiment, the results of comparing a sample result with a prior result is stored 
in the database 44. Because the comparison of sample results to sample results is logically 
5 equivalent to a comparison between two sets, (e.g., which members (genes) of set 1 are also 
members of set 2, which genes are only members of set 1), the results of the comparison can be 
stored in the same relational tables used to store a prior result. Thus, either bit vectors or lists of 
lists implemented relationally can be used. 

For example, if a first sample result includes genel and gene2, and a second sample 
10 result includes genel and gene3, then a comparison of the first and second sample results 

produces a third result that includes genel (i.e., the intersection of the two sample results). This 
third result can then be stored as an entry in a table, just like the first and second sample results. 

Fig. 5 shows an embodiment of a graphical user interface 150 presented to the client user 
from the server 20 for making associations between sample results and/or user-selected or user- 

15 generated gene categories. Through this interface 150, the client user perform searches across 
the entire database 44 for data sets that exercise particular genes or for identifying correlations 
between functions and expressions. The interface 150 contains two sections 152 and 154. Each 
section 152, 154 has a first graphical box 156, 156' in which to specify a prior result and a 
second graphical box 158, 158' in which to specify a sample result. The client user selects one 

20 of the two boxes 156 or 158 (and 156' or 158') in each section 152, 154, respectively. A drop 
down menu appears for each box 156, 156', 158, 158' presenting a menu of prior results or 
sample results that are available in the database 44. The client user selects the desired prior 
result or sample result from this menu, and the associated description of the selected prior result 
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or sample result appears in the respective box. Accordingly, the client user can initiate one of 
three types of comparisons: (1) a prior result with a prior result, (2) a prior result with a sample 
result, and (3) sample result with a sample result. Upon selecting the "Submit Query" button 
160, a comparison is performed between the two selected results. 

5 Examples of queries that the client user can attempt to answer through the interface 150 

are "which genes that are up-regulated under condition X encode for members of the ribosomal 
complex?" and "which conditions show considerable overlap with enzymatic activity Y?" Such 
data mining queries involve set comparisons and are implemented as partially constrained 
Cartesian products in SQL. 
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Fig. 6 shows a schema 200 representing an embodiment of an organization of the 
database 44. The schema 200 includes tables, one or more attributes in each table, and 
relationships between the tables (identified by arrows between the tables). Attributes that are 
primary keys are underlined. The tables shown and the attributes listed under each table are not 
5 intended to be exclusive. The schema 200 can include other tables and table attributes to 
implement the principles of the invention. 

As shown, the schema includes a SAMPLE_ON_CHIP table 202, a TSV_FILES table 
204, and a TSV_RAW table 206. The SAMPLE_ON_CHIP table 202 has a SampleJD attribute 
and a File_ID attribute for associating a sample of raw data with a file. The File JD operates as 
10 a secondary key that points to the TSVFILE table 204. The TSVRaw table 206 stores raw 
data values associated with a data set. An attribute of the TSVRaw table 606 is the File_ID, 
which also points to the TSV_Files table 204. The TSV_FILES table 204 includes one row 
corresponding to each data set loaded in the database 44 and the TSV_RA W table 206 contains 
one row for each probe present in the data file. 

1 5 The schema also includes a SAMPLES table 208, a GROW_CONDITION table 2 1 0, and 

a STRAIN table 212. The SAMPLES table 208 includes a CONDITIONJD attribute and a 
STRAIN_ID attribute that associate each sample in the table 208 with a growth condition and a 
strain, respectively. The CONDITIONED attribute operates as a secondary key for searching 
the GROW_CONDITION table 210, and the STRAINID attribute operates as a secondary key 

20 for searching the STRAIN table 212. Each entry in the STRAIN table 2 1 2 provides a description 
of the particular strain of organism and each entry in the GROW_CONDITION table 210 
provides a description under which a strain is grown. The SAMPLES table 208 also includes a 
SAMPLEJD attribute that corresponds to the SAMPLEJD attribute of the 
SAMPLE_ON_CHIP table 202. 
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Other tables in the schema 200 include a REFERENCE_SET table 214, a 
SAMPLE_IN_REFERENCE_SET table 216, a ABS_EXPRESSION table 21 8, and a 
AB S_D AT A_T AB table 220. The REFERENCE_SET table 214 groups samples that have been 
rescaled together using the same set of parameters and a single control sample. Each sample 
5 other than the control sample is rescaled using parameters and the values associated with the 
control sample. The SAMPLE_IN_REFERENCE_SET table 216 maintains the relationships 
between samples and reference sets. The SAMPLE_IN_REFERENCE_SET table 216 includes 
a Reference_set_ID attribute that is a secondary key for searching the REFERENCE_SET table 
214 and a Sample_ID attribute that points to the SAMPLES table 208. 

1 0 The ABS_EXPRESSION table 2 1 8 stores an entry for every chip that is inserted into a 

reference set. Attributes of the ABS_EXPRESSION table 218 store information describing the 
rescaling, such as scale factor and reference chip. The ABS_DATA_TAB table 220 stores 
rescaled data values and points to the SAMPLE_IN_REFERENCE_SET table 216. 

Still other tables in the schema 200 include a SAMPLE SET table 222, an 
1 5 ANALYSIS RESULTS table 224, a GENE_IN_LIST table 226, a PROJECTS table 228, a 
SAMPLE_IN_PROJECTS table 230, a SAMPLE_IN_SSET table 232, and an 
ANALYSIS_PARAMETERS table 234. 

The SAMPLE_SET table 222 groups samples that are analyzed together. In one 
embodiment, all samples in a sample set come from the same reference set. The 
20 ANALYSIS_RESULTS table 224 holds the sample result sets generated by an analysis. There is 
one entry in the ANALYSIS_RESULTS table 224 for each sample result produced by an 
analysis. Note that one analysis may produce multiple gene lists (thus, the sample result is a list 
of gene lists). The ANALYSIS_PARAMETERS table 234 identifies the parameters used to 
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perform a given analysis. There is one entry in the ANALYSIS_PARAMETERS table 234 for 
each analysis performed. The GENE_IN_LIST table 226 joins the sample results with the 
genetic features such results contain. There is one entry in the GENE_IN_LIST table 226 for 
each gene identified in a sample result. 

5 As described above in the Data Organization section, the PROJECTS table 228 holds 

projects which is an organizational construct that includes an arbitrary group of samples and the 
sample sets derived from such samples. Indirectly, the PROJECTS table 228 groups analyses. 
The SAMPLE_INJPROJECTS table 230 includes one entry per sample in a project. The 
SAMPLE_IN_SSET table 232, which includes one entry per sample in a project in sample set, 
1 0 associates samples in projects with sample sets. 

Example of Operation 

The overall operation of the invention is illustrated by the following example. In 
particular, this example demonstrates how a client user loads raw genomic data into the database 
44, generates sample results from genomic data in the database 44, and performs data mining by 
1 5 associating the stored sample results with other previously stored sample results and a user- 
selected or user-generated list of genes. 

Consider the following experiment conducted on two genes, YOR095C ("RKI1") and 
YFL014W ("HSP12") across four samples: two control samples and two deletions of 
"cse2/med9." Assume that RKI1 's expression drops by more than two-fold in this experiment, 
20 and HSP12 increases by at least two-fold. 

Data is loaded from one data file per array, produced by scanning software. Referring 
back to Fig. 3, the graphical user interface 130 presented to the client user includes fields 132 for 
identifying the data files from which to load the data and for associating sample information with 
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that data. In this example, there are four data files, one for each of the four chips associated with 
one sample. Each data file contains one or more measurements of interest per probe located on 
array. The loader 35 uploads each data file into multiple tables, including the TSV_RAW 206 
and TSV_FILES 204 tables. The TSVFTLES table 204 then contains one row for each data set 
5 loaded. The TSV_RAW table 206 contains one row for each probe present in the data file, as 
shown for example in TABLE 1 below: 



TABLE 1 



TABLE NAME 
TSV RAW 








FILE ID 


PROBE ID 


AVGDIFF 


CONF 


100 


200 


374 


P 


101 


201 


258 


P 



Using the SAMPLE_ON_CHIP table 202, the data set is associated with sample 



information describing the sample and the chip (array) on which the sample was hybridized, as 
1 0 shown in TABLE 2 below: 



TABLE 2 



TABLE NAME 
SAMPLE ON CHIP 






SAMPLE ID 


FILE ID 


CHIP ID 


300 


100 


400 


300 


101 


401 



Then the loaded data is rescaled with respect to a pre-defined set of rescaling parameters 
(reference set). The rescaling constants for each data file are stored in the ABS_EXPRESSION 
table 218, as shown in TABLE 3 below: 
15 TABLE 3 



TABLE NAME 
ABS EXPRESSION 






RESCALED SAMPLE ID 


CHIP ID 


FACTOR 


500 


400 


0.60953 


500 


401 


0.78251 
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The raw data is divided by the appropriate rescaling factor and stored in the 
AB S_D AT AT AB table 220. Using the ABS_DATA_TAB table 220, each data point is 
associated with the gene that the probe queries, as shown in TABLE 4 below: 



TABLE 4 



TABLE NAME 
ABS DATA TAB 








RESCALED SAMPLE 
ID 


GENE 


AVGDIFF 


CONFIDENCE 
(present (P)) 


500 


YOR095C 


613.6 


1 


500 


YFL014W 


329.7 


1 



5 The above-described rescaling process is repeated for all samples to be compared in an 



analysis. Referring now to Fig. 4, the type 141 of analysis is chosen, here static analysis ("SA"), 
and the rescaled samples 142 to be analyzed together are selected to define a sample set. Static 
analysis is an appropriate analysis for systems in equilibria (e.g., knockouts, deletions, 
mutations). The rescaled samples 142 are collected into SAMPLE_IN_SAMPLE_SET 232 as 
10 shown in TABLE 5 below. All samples in the sample set are derived from the same reference 
set. 



TABLE 5 



TABLE NAME 

SAMPLE IN SAMPLE SET 






ID 


SAMPLE SET ID 


RESCALED SAMPLE ID 


600 


700 


500 


601 


700 


501 


602 


700 


502 


603 


700 


503 



The type 144 and replicate 146 fields are used to structure the comparison between the 



samples in the sample set. For the static analysis of the present example, samples of sample type 
15 "WT" (i.e., wild type) are compared against samples of sample type "MT" (i.e., mutant type). 
Also, replicate samples are compared against samples of the same replicate, e.g., replicate 1 
samples are compared against replicate 1 samples, and replicate 2 samples are compared against 
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replicate 2 samples. Various other types of comparisons are possible, For example, another 
method for comparing the samples in the sample set is to average the mutant replica values and 
to divide that average by the average of the wildtype values. 

The selected analysis is performed and the sample results are stored. In this example, the 
5 analysis performed compares the average expression level of the control samples to that of the 
test samples for each gene, determining if the genes differ by more than a factor of 2 either up or 
down. If the test samples are at least 2 times (2X) the control samples, the gene is assigned to 
the "up" result. If test samples are at least 2X lower, then the gene is assigned to the "down" 
result. Referring to TABLE 6 below, the selected analysis (here, ANALYSIS ID 900) illustrates 
10 an example of an analysis that can produce multiple lists of genes (i.e., a list of lists): one list for 
"up" genes, and another list for "down" genes. 



TABLE 6 



TABLE NAME 
ANALYSIS RESULTS 






ID 


ANALYSIS ID 


NAME 


800 


900 


up 


801 


900 


down 



As shown in TABLE 7, the GENE IN LI ST table 226 associates each gene with the 



appropriate result(s) for that gene: 
15 TABLE 7 



TABLE NAME 
GENE IN LIST 




GENE 


RESULT ID 


YOR095C 


801 


YFL014W 


800 



Now answers to questions such as "which genes were in result "up" in analysis x and in 
analysis y" can be provided by the database 44. In the present example, the gene YFL014W is a 
gene with an "up" result. 
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Also, exhaustive searches such as "find two sets, X and Y, such that set X o set Y and 
{X} = {Y}" (i.e., find any two overlapping sets) can be performed. For example, searching 
through a filter set of user-defined sets (e.g., the MIPS categories) for the gene YFL014W, one 
may find the gene YFL014W in the groups shown in TABLE 8. Table 8 is a subset of rows in a 
5 relational table containing categories that include the gene YFL014W. 



TABLE 8 



ID 


GROUP I 
D 


U_DESC 


EXTJD 


ID_1 


UCAT I 
D 


551 


286 


Signal transduction 


1000000 
0 


2264 
8 


551 


557 


286 


Osmosensing 


1003000 
0 


2278 
4 


557 


561 


286 


Other osmosensing activities 


1003990 
0 


2280 
5 


561 


575 


286 


Cell rescue, defense, cell death and 
aging 


1100000 
0 


2322 
1 


575 


576 


286 


Stress response 


1101000 
0 


2333 
3 


576 


577 


286 


DNA repair (direct repair, base 
excision repair and nucleotide excision 
repair) 


1104000 
0 


2349 
9 


577 



If the selected analysis (ANALYSIS_ID = 900) determined that multiple genes were in 
the "up" result, then the statistical significance of an overlap of the genes in the "up" result with 
the genes in any of these categories could be assessed. 

10 Fig. 7 shows an example of a display 240 at the client 10 that is produced when searching 

for the gene YFL014C in sample results previously stored in the database 44. The gene view 
shows HSP12 (YFL014C) in the result "up" for the "cse2/med9," "sin4," and "srblO" 
experiments 242. Additional information stored for each sample result is also shown, namely a 
value 243 and a graphical representation 244 of the fold change for each experiment (here, 9.35 

15 for the cse2/med9 experiment, 1 1.51 for the sin4 experiment, and 32.75 for the srblO 
experiment). 
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While the invention has been shown and described with reference to specific preferred 
embodiments, it should be understood by those skilled in the art that various changes in form and 
detail may be made therein without departing from the spirit and scope of the invention as 
defined by the following claims. 
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Claims 

1 1 . A method for analyzing data over a network, comprising the steps of: 

2 receiving data; 

3 rescaling the data to produce rescaled data; 

4 associating the rescaled data with a pre-selected set of parameters; 

5 generating a sample set from the associated rescaled data; 

6 performing analysis on the sample set to produce a sample result; 

7 storing the sample result in a database; and 

8 associating the stored sample result with a prior result. 

1 2. The method of claim 1 wherein the prior result is a sample result previously stored in the 

2 database. 

1 3. The method claim 1 wherein the prior result is a user-generated result. 

1 4. The method claim 1 wherein the prior result is a user-selected result. 

1 5. The method of claim 1 storing the rescaled data in the same database as the sample result. 

1 6. The method of claim 1 wherein the stored sample result is a list of lists. 

1 7. The method of claim 6 wherein each list in the list of lists is a list of genes. 

1 8. The method of claim 1 wherein the stored sample result is a set of bit vectors. 

1 9. The method of claim 1 where the associating comprises comparing the sample result with 

2 the prior result. 

1 1 0. The method of claim 9 further comprising storing the results of associating the stored 

2 sample result with the prior result in the database. 

1 11. The method of claim 1 further comprising defining a reference set to be used as a control 

2 for rescaling the provided data. 

1 12. A system for analyzing data, comprising: 

2 a calibrator rescaling the data; 



WO 00/70556 PCT/US00/13823 



-33 - 

3 a pre-selected set of parameters associated with the rescaled data; 

4 a sample set generated from the associated rescaled data; 

5 an analyzer performing analysis on the sample set to produce a sample result; 

6 a database storing the sample result; and 

7 an associator associating the stored sample result with a prior result. 

1 13. The system of claim 12 wherein the prior result is a sample result previously stored in the 

2 database. 

1 14. The method claim 12 wherein the prior result is a user-generated result. 

1 15. The method claim 12 wherein the prior result is a user-selected result. 
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